OBJECT HANDLING APPARATUS 
BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an object handling apparatus for 
handling an object such as a workpiece using a robot to transfer the object from 
one place to another place. 

2. Description of Related Art 

For automatically performing machining of workpieces, assembling of 
parts, etc., robots are used as means for transferring objects such as workpieces 
and parts from one process to the next process. In the case where the next 
process is machining of an object by a machine such as a machine tool, it is 
required that the object is precisely positioned to have a predetermined 
position/orientation so as to be mounted by an object mounting jig of the 
machine tool. Similarly, in the case of assembling of parts, it is required that 
the objects held by the robot is precisely positioned to have a predetermined 
position/orientation in transferring the object to the next process. 

To meet the above requirements, conventionally, the objects are 
supplied by pallets having positioning devices such as positioning jigs for 
positioning the objects on the pallets so that the robot holds the objects having 
predetermined position/orientation. By supplying the objects positioned on 
the pallets by the positioning devices, the robot securely holds the object at a 
predetermined holding position/orientation taught in advance. However, there 
are problems that the pallets equipped with the positioning devices are of high 
price and a great number of pallets with different kinds of positioning devices 
have to be prepared for different kinds of objects. 

Further, if the object is greatly displaced from the predetermined 
position/orientation on the pallet by an unexpected cause, the robot fails in 
holding the object by a robot hand to cause a stoppage of the automatic 
operation. 
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Even if the object is held by the robot hand, if position/orientation of 
the object held by robot hand relative to the robot hand is displaced from the 
predetermined position/orientation, there arise a problem in transferring the 
object to the next process. For example, in the case where the next process is 
machining of the object by the machine such as a machine tool, if there is a 
displacement of the position/orientation of the object relative to the robot hand, 
the object can not be mounted on the machine by the object mounting jig. 

To cope with the above problem, various kinds of robot hands designed 
for various shapes and materials of the objects have been prepared so that the 
position/orientation of the object held by the robot hand relative to the robot 
hand is not displaced from the predetermined position/orientation. However, 
it is necessary to prepare a large number of robot hands designed for holding 
the various kinds of objects, and also rests for placing the large number of 
robot hands are necessary so that an installing area of the apparatus increases, 
to rise manufacturing cost of the apparatus and products. 

SUMMARY OF THE INVENTION 

The present invention provides an object handling apparatus capable of 
securely holding an object and precisely transferring the held object from a first 
place to a second place without need of a specific jig for positioning the object 
on a pallet. 

According to one aspect of the present invention, an object handling 
apparatus comprises: a robot having a robot hand for holding the object; 
detecting means for detecting position/orientation of the object held by the 
robot hand relative to the robot hand; and compensating means for 
compensating position/orientation of the robot hand for transferring the object 
to the second place based on the position/orientation of the object relative to 
the robot hand detected by the detecting means. 

According to another aspect of the present invention, an object 
handling apparatus comprises: a robot having a robot hand for holding the 
object; first detecting means for detecting a position of the object supplied to 
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the first place; control means for moving the robot hand to a holding position 
for holding the object using the detected position of the object detected by the 
first detecting means and for controlling the robot hand to hold the object at the 
holding position; second detecting means for detecting position/orientation of 
the object held by the robot hand relative to the robot hand; moving means for 
moving the robot hand or the second detecting means such that the robot hand 
holding the object has a predetermined detecting position/orientation relative to 
the second detecting means; and compensating means for compensating 
position/orientation of the robot hand predetermined for transferring the object 
to the second place based on the position/orientation of the object held by the 
robot hand relative to the robot hand detected by the second detecting means. 

The object may be transferred by the object handling apparatus to a jig 
of a machine tool at the second place. The robot hand may have fingers 
driven by one or more servomotors. In this case, the robot hand may hold the 
object by positioning of the fingers by the one or more servomotors in 
accordance with a shape of the object. The command torques to the one or 
more servomotors for driving the fingers of the robot hand may be altered in 
accordance with characteristics such as material and shape of the object, and 
the one or more servomotors may be controlled by a controller of the robot. 

The first detecting means may comprise a two-dimensional visual 
sensor or a three-dimensional visual sensor. Also, the second detecting means 
may comprise a two-dimensional visual sensor or a three-dimensional visual 
sensor. The first detecting means may function as the second detecting means. 
The moving means may comprise an additional robot to which the second 
detecting means is attached. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective view of an object handling apparatus in a state 
of taking out an object from a pallet by a robot according to an embodiment of 
the present invention; 

FIG. 2 is a perspective view of the handling apparatus in a state of 
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mounting the object on an object mounting jig of a machine: 

FIG. 3 is a block diagram of a control section of the object handling 
apparatus; and 

FIG. 4 is a flowchart of processing to be performed by a processor of 
the Object the handling apparatus. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

First, a general arrangement of an object handling apparatus according 
to an embodiment of the present invention will be described referring to FIGS. 
1 and 2. 

As shown in FIG. 1, an object W placed on a pallet 21 and stored in an 
automatic storehouse 20 is supplied to an object supply place with the pallet 21 
by a conveying device 22. A first robot 10b is arranged such that an 
operational range thereof covers the workpiece supply place and also an install 
place of a machine 30 such as a machine tool. The first robot 1 Ob takes out an 
object W from the pallet 21 by holding the object W by a hand 1 1 attached to a 
wrist thereof and transferring the held workpiece W to an object mounting jig 
31 of the machine 30. 

A fist visual sensor 23 as first detecting means for detecting 
position/orientation of the supplied workpiece W is arranged in the vicinity of 
the object supply place. The first visual sensor 23 may be a two-dimensional 
sensor for detecting the position/orientation of the supplied workpiece, or a 
tln-ee-dimensional sensor for detecting the position/orientation of the supplied 
workpiece more precisely. 

In this embodiment, a second robot 40 is arranged such that an 
operation range thereof overlaps the operation range of the first robot 10b and a 
second visual sensor 41 as second detecting means is attached to a wrist of the 
second robot 40. The second visual sensor 41 is provided for detecting 
position/orientation of the workpiece W held by the hand 1 1 of the first robot 
1 lb relative to the hand 1 1 . The second robot 40 is provided for placing the 
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second visual sensor 41 to have position/orientation where a displacement of 
the position/orientation of the workpiece W held by the hand 1 1 of the first 
robot 10b relative to the hand 1 1 from a reference position/orientation. 

A servo hand having fingers driven by one or more servomotors is 
adopted as the hand 1 1 of the first robot 10b and a position and a force of 
gripping by the fingers are controllable. The one or more servomotors for 
driving the fingers are controlled by a servo control section of the robot 
controller of the first robot 10b. 

FIG. 3 shows a robot controller 10a of the first robot 10b which 
functions as a control section of the object handling apparatus. 

A main processor (CPU) 1, a memory including a RAM, a ROM and a 
nonvolatile memory (EEPROM, etc.), an interface 3 for a teaching operation 
panel 4, an interface 6 for external devices and a servo control section 5 are 
connected to a bus 7. 

A system program for supporting a basic function of the robot 
controller 10a is stored in the ROM of the memory 2. Operation programs 
and associated data therewith prepared by teaching operations to the robot for 
respective applications are stored in the nonvolatile memory of the memory 2. 
The RAM of the memory 2 is used for temporary storage of data in arithmetic 
operations by the processor 1 . 

The servo control section 5 comprises servo controllers Sal -San (n: the 
sum of the number of axes of the robot and the number of axes of the servo 
hand), each of which including a processor, a ROM and a RAM to perform a 
position and velocity loop control and a current loop control of an associated 
one of the servomotors Ml-Mn. Each of the servo controllers Sal -San is 
constructed as a digital servo controller which performs the position, velocity 
and current loop controls by software means. The servomotors Ml-Mn are 
respectively driven by the servo amplifiers 5bl-5bn in accordance with the 
outputs of the servo controllers Sal -San. Although not shown in FIG. 3, 
position/velocity detectors are respectively provided at the servomotors 
Ml-Mn, and position/velocity of the respective servomotors detected by the 
position/velocity detectors are respectively fed back to the servo controllers 
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5al-5an. The first visual sensor 23, the second visual sensor 41, a robot 
controller of the second robot 40, a controller of the automatic storehouse 20, a 
controller of the machine 30 and further the peripheral devices of the first robot 
are connected to the input/output interface 6. 

The robot controller haying substantially the same hardware 
configuration as a conventional robot controller is adoptable as the robot 
controller 10a of the first robot 10b. The above-described robot controller 
10a constitutes the control section of the object handling apparatus of the 
present invention. 

An operation of the object handling apparatus according to the 
embodiment will be described referring to a flowchart of FIG. 4. FIG. 4 
shows processing to be performed by the processor 1 of the robot controller 
10a of the first robot 10b which functions as the control section of the object 
handling apparatus. 

When a command for transferring an object from the object supply 
place to the machine is inputted to the robot controller 10a of the first robot 10a 
(the control section of the handling apparatus) from the controller of the 
machine 30 through the interface 6, the main processor 1 of the robot controller 
10a starts the processing shown in FIG. 4. 

A command for capturing an image of an object is outputted to the first 
visual sensor 23 through the interface 6 (Step SI), and the processor 1 waits an 
arrival of a position/orientation compensation amount from the fist visual 
sensor 23 (Step S2). The first visual sensor 23 captures an image of the object 
W supplied at the object supply place upon receipt of the image capturing 
command from the processor 1 of the robot controller 10a. The first visual 
sensor 23 calculates a displacement of the position/orientation of the supplied 
object W from a predetermined reference position/orientation and sends the 
displacement as position/orientation compensation amount to the controller 
10a. 

The processor 1 decides position/orientation for the robot hand 1 1 for 
taking out an object by compensating the position/orientation taught in advance 
based on the compensation amount received from the first visual sensor 23, and 



6 



moves the robot hand 1 1 to have the decided position/orientation for taking out 
the supplied object and operates the robot hand 1 1 to hold the object W with 
the fingers (Step S3). Then, the processor 1 issues a command to move the 
second visual sensor 41 to an object image capturing position to the controller 
of the second robot 40 (Step S4). 

It is determined whether or not the holding operation of the object W 
by the robot hand 1 1 is completed based on determination whether or not an 
output torque (driving current) of the servomotors for driving the fingers of the 
robot hand 1 1 reaches set values (Step S5). Alternatively, the completion of 
the holding operation may be determined based on an output of a force sensor 
for sensing griping force of the fingers. When it is determined that the 
holding operation is completed, a command to move the held object W to the 
place of image capturing by the second visual sensor 41 is issued (Step S6), 
and a signal indicating completion of taking out the object is issued to the 
automatic storehouse 20 (Step S7). The controller of the automatic 
storehouse 20 returns the empty pallet 21 into the storehouse and supplies a 
new pallet 21 on which another object is placed to the object supply place. 

The processor 1 outputs an image capturing command to the second 
visual sensor 41 (Step S8). The second visual sensor 41 captures an image of 
the object W held by the robot hand 1 1 upon receipt of the image capturing 
command. The controller of the second visual sensor 41 calculates a 
displacement of the position/orientation of the object W relative to the robot 
hand 1 1 from a predetermined reference position/orientation and sends the 
displacement as a held position/orientation compensation amount to the 
controller 10a of the first robot 10b. The processor 1 issues a command to the 
second robot 40 to return to a home position (Step SI 0) upon receipt of the 
held position/orientation compensation amount (Step S9). The processor 1 
compensates the position/orientation taught in advance for clamping of the 
object by the object mounting jig of the machine 30 based on the held 
position/orientation compensation amount received from the second visual 
sensor 41, and moves the robot hand 11 to have the compensated 
position/orientation at which the workpiece W is clamped by the object 
mounting jig (Step Sll). 
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Upon receipt of a clamping completion signal from the controller of the 
machine 30 (Step SI 2), the robot hand 1 1 is opened and moved to the home 
position (Step SI 3), to terminate the processing of transferring the object W to 
the machine 30. 

Since the servo hand having fingers driven by one or more servomotors 
is adopted as the robot hand 11 for holding an object W, an object W is 
securely and precisely held by the fingers of the robot hand 1 1 by controlling 
gripping positions of the fingers by the servomotors even if the object to be 
handled has a different shape. Further, a desired holding force suitable for 
shape, material, hardness and weight of the object is obtained by setting 
command torques for obtaining the desired holding force to the controllers of 
the servomotors for driving the fingers of the robot hand 1 1 . Thus, it is not 
necessary to prepare a number of robot hands designed for different kinds of 
objects, so that the number of robot hands is reduced. Further, since the 
position of the fingers of the robot hand is controllable, objects densely placed 
on the pallet can be held by the fingers so that a large number of objects can be 
arranged on the pallet to improve an efficiency of arrangement of the objects 
on the pallet. 

Since the servomotors of the servo hand are controlled by the servo 
controllers in the root controller 10a of the first robot 10b to which the servo 
hand is attached, it is not necessary to provide controllers dedicated for the 
servo hand to reduce a manufacturing cost and the servo hand can cooperate in 
synchronism with the operation of the first robot to improve an operation 
efficiency. 

In the foregoing embodiment, two visual sensor of the first visual 
sensor 23 and the second visual sensor 21 are provided. However, a single 
visual sensor may function as the two visual sensors. For instance, the second 
robot 40 may operate to move the visual sensor 41 attached to the second robot 
40 to have the position/orientation for capturing an image of an object W 
supplied to the object supply place, and a displacement of the 
position/orientation of the supplied object W is obtained based on the captured 
image of the object W and sent to the robot controller 10a of the first robot 10b, 
so that the visual sensor 41 performs the function of the first visual sensor 23 in 
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the foregoing embodiment, as well as performs the function of the second 
visual sensor for capturing an image of the object W held by the robot hand 1 1 
to detect a displacement of position/orientation of the object relative to the 
robot hand 11. 

Further, in the foregoing embodiment, the second visual sensor 41 is 
attached to the wrist of the second robot 40. The second visual sensor may be 
arranged at a fixed position instead of being attached to the wrist of the second 
robot 40. In this case, the second visual sensor captures an image of the 
object W held by the robot hand 1 1 with predetermined position/orientation. 
Further, in dependence of a shape of the object and the operation range of the 
first robot 10a for holding the object, the first visual sensor 23 may capture an 
image of the workpiece W hold by the robot hand 1 1 of the first robot 10b to 
detect the position/orientation of the held object W relative to the robot hand 
1 1, as well as capture an image of the workpiece W supplied to the object 
supply place. 

The foregoing embodiment is directed to an operation of transferring an 
object supplied from the automatic storehouse 20 to the machine 30. 
However, the present invention is applicable to various usages as follows; 

a. In supplying an object such as a plate to a welding position, the 
object can be moved to the welding position/orientation by compensating a 
displacement of the position/orientation of the object held by the robot hand to 
precisely supply the object with the welding position/orientation. Further, in 
welding an object such as a plate as being held by the robot hand, the robot 
hand is moved so that a displacement of the position/orientation of the object 
on the robot hand is compensated to thus eliminate a displacement of welding 
position and realize precise welding. 

b. In an assembling operation of parts of an automobile and an 
electric device, a displacement of position/orientation of the part held by a 
robot hand is compensated so that the part is precisely moved to have a 
predetermined assembling position/orientation, to improve efficiency of the 
assembling operation. 

c. In an operation of automatically inspecting an object, a 
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displacement of the position/orientation of the object held by the robot hand is 
compensated so that the object is always supplied to have a predetermined 
inspecting position/orientation, to improve an efficiency of the inspection 
operation. 

d. In supplying an object to a deburring place by a robot hand or in 
performing a deburring operation on an object held by a robot hand, a 
displacement of the position/orientation of the object held by the robot hand is 
compensated so that the object is moved to have predetermined 
position/orientation, to perform a precise deburring operation. 

e. In supplying an object to a sealing place for sealing operation or in 
perform a sealing operation on an object held by the robot hand while moving 
the object, a displacement of the position/orientation of the held object relative 
to the robot hand is compensated in the same manner as in the foregoing 
embodiment, to perform a precise sealing operation. 

f. In an operation of supplying an object to a painting place for painting 
the object, and an operation of supplying an insert part to an insert place in a 
mold of an injection molding machine, a displacement of the 
position/orientation of the held object relative to the robot hand is compensated 
so that the object is supplied precisely to improve efficiency of the operation. 

According to the present invention, an object is precisely positioned to 
have predetermined position/orientation by a robot even if position/orientation 
of the object held by a robot hand is displaced in gripping the object by the 
robot hand, to improve efficiency of the operation. Thus, the object is 
precisely transferred from an object supply place to a machine without using an 
object positioning jig on a pallet, to eliminate cost for providing the object 
positioning jig on the pallet. Further, since an object is securely held by the 
robot hand even if the objects are different in shape, hardness, material and 
weight, or the objects are densely arranged on the pallet, it is not necessary to 
prepare various kinds of robot hands for the different kinds of objects and 
efficiency of arranging the objects on the pallet is improved, to reduce the cost 
of manufacturing. 
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